Amazon Elastic MapReduce and Hadoop Streaming. You just write a few lines of python (or your language of choice), upload your data, and it takes care of the rest.
Ask HN: What are the best technologies you've worked with this year?
51–60 of 86 posts
Re: Ask HN: What are the best technologies you've worked with this year?
#52Rabbitmq (and AMQP in general). It's just simple, straightforward message passing. My C++ process creates a queue, and binds it to the key "yummyfajitastasks". My python process (a django webapp, in this case) sends messages with the key "yummyfajitastasks". My c++ process receives them, does work, sends messages back. Combine this with JSON or some serialization method and you've almost got erlang style messaging, e…
You suffix both C++ and Python with process , this makes me question how this is any different than using a socket?
I oversimplified my example.
In fact, my C++ code doesn't listen to a single queue, but many. So that simple messaging piece is equivalent to either having many separate sockets open or multiplexing many communication channels over a single socket. I also don't need to worry about message boundaries, AMQP handles that for me. Instead of building a state machine with boost::asio that parses messages, I just call "get_next_message". [1]
Also, I can have one-to-many communication if I want with no code change on the part of the sender. Suppose I have a third ruby process which is also interested in "yummyfajitastasks". I can create a queue, and listen for messages with the key "yummyfajitastasks".
The ruby process might also be interested in "sorbitstasks" (which the c++ process is not), so it could then bind it's queue to the key "sorbitstasks. So now, "yummyfajitastasks" -> c++, ruby. "sorbitstasks" -> ruby.
Messages are persistent (if you want them to be) as well.
[1] The c bindings are a bit ugly, but you can wrap it fairly easily.
Re: Ask HN: What are the best technologies you've worked with this year?
#53Clojure. It's the first Lisp that, to me, is both fun _and_ practical. Java libraries aren't as simple as the Python counterparts but the maturity of the JVM vs. Python VM kind of balances that out.
Do you recommend a good tutorial for someone who knows Python and wants to learn Clojure?
Re: Ask HN: What are the best technologies you've worked with this year?
#54- Play! Framework - finally something close to Rails productivity for Java developers. And supports Scala too. - Redis - the fastest NoSQL engine around. Easy and elegant. - Solr - Indexing for the masses. If it only had real time search...
Agree with the Solr. I started using it this year and it definitely simplifies and speeds up our searches.
Re: Ask HN: What are the best technologies you've worked with this year?
#55-VirtualBox ( http://www.virtualbox.org ) -ASP.NET MVC -Visual Studio 2010
I'd also like to add that as of this year I'm also using 7zip (which replaced winrar, which replaced winzip). I've also started a new job, we are using TFS for source control which was new to me. And does Windows 7 count?
Re: Ask HN: What are the best technologies you've worked with this year?
#56Clojure. It's the first Lisp that, to me, is both fun _and_ practical. Java libraries aren't as simple as the Python counterparts but the maturity of the JVM vs. Python VM kind of balances that out.
What problem did you solve using it?
I've been studying Clojure and it seems to be impressive. But I have yet to see some really impressive open source software that was written in it.
Re: Ask HN: What are the best technologies you've worked with this year?
#57F#. I work in a primarily Microsoft-based environment, and I wanted to learn a functional language, so F# is a good choice for me - I can actually put it to use at my "day job". jQuery. A great javascript library.
FParsec is a great parser library for F#.
I learned F# and built a DSL in about a week using it.
Re: Ask HN: What are the best technologies you've worked with this year?
#58Revisor (see: http://forums.fedoraforum.org/showthread.php?t=236679).
The ability to create custom Linux spins and even full system software thumbdrives make drive failures / system recovery much less impacting. It also makes "ready to go" installations a snap.
Re: Ask HN: What are the best technologies you've worked with this year?
#59Amazon EC2
Engine Yard's Flex
Ruby on Rails
Ruby
Re: Ask HN: What are the best technologies you've worked with this year?
#60Seaside
Seaside and Smalltalk are awesome. Sadly the last few months i had to resort to hideous creatures like telerik and asp.net to cobble up complex grids of some sorts. I wish there were more widgets for Seaside. Perhaps I'm missing a community site somewhere for these?
Not really. There is some out there but not much yet. More people creating those sorts of things are needed while the core seaside team concentrates on their job.