LinkedIn Hiring Staff Software Engineer-Bangalore
Company Name : Linkedin
Website
:www.linkedin.com
Qualification
:B.E/B.Tech
Experience
:Freshers
Location
:Bangalore
Job Role
: Staff Software Engineer
Job Description
:
The engineering culture at LinkedIn is based on building and integrating cutting-edge technologies while encouraging creativity, innovation, and expansion. Our engineers constantly raise the bar for excellence, motivating each other to tackle challenges and take intelligent risks. The industry is moving fast and our engineers are right there with it! http://engineering.linkedin.com/
The challenge here is not only related to scale, but also to the diversity of inputs and outputs as well as to the various requirements of timeliness and timeline consistency. We want to create a framework that elegantly expresses data dependencies, process dependencies, transformations, process idempotence etc. Building a framework that can satisfy all these requirements will call for a deeply systems oriented solution that is not your traditional metadata implementation or ETL tool. Built right, the metadata framework can also be leveraged by systems to optimize query processing on Hadoop and RDBMS — so this is extremely high leverage work.
The challenge here is not only related to scale, but also to the diversity of inputs and outputs as well as to the various requirements of timeliness and timeline consistency. We want to create a framework that elegantly expresses data dependencies, process dependencies, transformations, process idempotence etc. Building a framework that can satisfy all these requirements will call for a deeply systems oriented solution that is not your traditional metadata implementation or ETL tool. Built right, the metadata framework can also be leveraged by systems to optimize query processing on Hadoop and RDBMS — so this is extremely high leverage work.
- Mission:
- Build the above metadata framework to work across Hadoop, RDBMS and NoSQL stores
- Assist in migrating all existing ETL flows to this framework
- Assist in building an ETL framework that will significantly move the needle toward a self-service model
0 comments:
Post a Comment