Big Data Engineer wanted

Big Data // Fortune 500

Elnézést a  kérdésemért, de
milyen területet jelent 'ez' a Big Data ?

(Genetikai kutatások, Gyógyszeripar, Telco rendszerek, Log analízis, ....  )

The current architecture has not been, and will not be detailed on this forum due to being confidential information, therefore it is really difficult to deduct what this project is really about, What i can give you though, is that the solution we are preparing will essentially be a substitute version of a currently running System (which actually is part of a much larger operation) with the aim of being a much better solution altogether. Hence the need for quality engineers.

Daily 600g is nothing what even a hobbyist couldnt handle with decent server power. If you tell, previous expertise there failed to maintain the development, then you have some other kind of problem - surely not i.t. context. For start, what about being honest?

We are talking about 600 GB of incoming data, daily. In raw form it is compressed, plain text which needs to be processed. 
For Python, the current system is written in python, so it’s certainly an advantage if one can read that code base easily. We don’t want to stick with python or to the old System though, our goal is to modernize the architecture, and prefer to do so on another lang.

How much is a lot of data?  In what are they?  And why you want a python programmer?

Our Machine Learning and Data analytical project with our Hong Kong based client has reached the milestone, where we enter the innovational status of not yet discovered areas. To succeed there, we are looking for engineers, who we push so much that will make them sweat and will submit to the job interview of their lifetime.

We are looking for the following skills in our candidate:

• Experience on the field of Big Data Analysis
• Relevant knowledge of Real-time Data Processing
• Quality knowledge of any or all the programming languages: Scala, Python, Node.js, C++
• Having worked with and understanding Event Tracking Systems


What we offer:

Occasionally on-site work in Hong Kong or New York

For the rest of the info, you should come and see us :)
You can contact us on hr@redsteedstudios.com.