Data Engineer

Location
Stanford
Posted
Jul 28, 2017
Institution Type
Four-Year Institution


Stanford University

Data Engineer

Job Number:
75797

JOB DESCRIPTION

Data Engineer Job Family: Information Technology Services Job Series: Business Intelligence Engineer Job Code: 4777 Grade: K Exemption: Exempt Note: Not all unique aspects of the job are covered by this job description

**This is a two year fixed term assignment** The Data Engineer is a key member of the Operational Intelligence (OI) team within the Financial Management Services (FMS) group. The OI team is responsible for assisting numerous FMS departments develop key business insight through the analysis of structured and unstructured data. Under minimal supervision, this role will be tasked with utilizing a wide variety of data extraction and preparation techniques in order to create and manage data sets to be analyzed or reported on for business decision making. The data engineer must creatively apply diverse data cleansing and transformation techniques as well as set up flexible data repositories that keep up-to-date data and allow for easy querying by other members of the team.


JOB PURPOSE: Responsible for development of complex technical analysis and design, new programming, modifications, scheduling, tuning, testing and maintenance of systems in support of new and existing data-centric projects.

Specific responsibilities of this position include:
  • Extract, transform, and load data to and from various data sources including relational databases, NoSQL databases, web services, and flat files

  • Design and implement scalable and high performance data repositories

  • Develop, optimize, and manage code used in ETL and data mining

  • Implement NLP techniques to parse text data for the purpose of topic modeling and document clustering

  • Setup and maintain scheduled data loads to ensure up-to-date information and data consistency

  • Profile and validate sources of data where very little metadata is provided

  • Produce various technical documents such as ER diagrams, table schemas, data lineage, API docs, etc.

    CORE DUTIES*:

    • Provide complex analysis, conceptualize, design, implement and develop solutions for critical data-centric projects.
    • Perform dataflow, system and data analysis and develop meaningful and useful presentation of data in downstream applications.
    • Plan and implement standards, define/code conformed global and reusable objects, perform complex database design, data repository modelling
    • Consult with client groups to assess user needs and understand the business processes; convert user requirements into technical solutions.
    • Contribute to data analysis, design and development of new and ongoing data-centric projects involving complex data repository or transactional source systems.
    • Collaborate closely with internal and external teams to understand and apply changes/modifications impacting data repositories.
    • Conduct and participate in code walkthroughs and document technical design. Assist in quality control testing. Meticulously follow software methodologies defined.
    • Monitor ETL processes, system audits, dashboard reporting and presentation layer functioning and performance. Pro-actively resolve issues as found. Support the performance of systems.
    • Follow the release cycles and implement on-time delivery of bug fixes, change requests and enhancements. Troubleshoot and solve technical problems.

    * - Other duties may also be assigned MINIMUM REQUIREMENTS: Education & Experience: Bachelor's degree and seven years of relevant experience in computer science, or engineering or a combination of education and relevant experience.


    Knowledge, Skills and Abilities:
  • Strong programming skills including the ability to create highly flexible and performance-tuned user defined functions

  • Extensive knowledge in Python or equivalent scripting language.

  • Extensive knowledge of querying languages for both SQL and NoSQL databases

  • Expertise in managing and administering MongoDb, Oracle, MySQL, and MS Access databases

  • Experience extracting data from web services and working with JSON and XML output

  • Experience with programmatic ETL platforms such as Airflow
  • Prior experience working directly with data scientists and report developers

  • Strong analytical capabilities, strategic thinking skills, and problem-solving abilities
  • Strong listening, verbal and written communication skills

  • Experience eliciting, interpreting, and documenting user requirements in the context of data analysis

  • Ability to manage multiple activities in a deadline-oriented environment; highly organized, flexible and rigorous attention to detail.

  • Preferred experience with data visualization tools such as Tableau, D3

    • Understanding of software engineering principles and skills working on Unix/Linux/Windows Operating systems, Version Control and Office software.
    • Strong programming skills, relational database skills with expertise in Advanced Sql and PL/Sql. Skills in Shell Programming and any Object Oriented Programming language.
    • Ability to design Physical and Reporting Data models for seamless cross-functional and cross-systems data reporting.
    • Able to design complex ETL's extracting data through XML files, RDBMS and Flat file sources.
    • Should be able to write custom ETL programming from complex data processing and transformations using any programming language, such as PL/Sql, Python, Java, etc.
    • Extensive experience in data analysis and root cause analysis and proven problem solving and analytical thinking capabilities.
    • Ability to prioritize workload and work with minimal supervision.
    • Experience with scripting language like Python, Shell, JavaScript, HTML5.

    Certifications and Licenses: None
    PHYSICAL REQUIREMENTS*:
    • Constantly perform desk-based computer tasks.
    • Frequently sitting.
    • Occasionally stand/walk.
    • Rarely writing by hand; lift/carry/push/pull objects that weigh up to 10 pounds.
    * - Consistent with its obligations under the law, the University will provide reasonable accommodation to any employee with a disability who requires accommodation to perform the essential functions of his or her job.


    WORKING CONDITIONS: WORK STANDARDS:

    • Interpersonal Skills: Demonstrates the ability to work well with Stanford colleagues and clients and with external organizations.
    • Promote Culture of Safety: Demonstrates commitment to personal responsibility and value for safety; communicates safety concerns; uses and promotes safe behaviors based on training and lessons learned.

    Subject to and expected to comply with all applicable University policies and procedures, including but not limited to the personnel policies and other policies found in the University's Administrative Guide, http://adminguide.stanford.edu/.


    Stanford is an equal opportunity employer and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law.



    Job: Information Technology Services

    Location: Business Affairs: Financial Management Services (FMS)
    Schedule: Full-time
    Classification Level:

    To be considered for this position please visit our web site and apply on line at the following link: stanfordcareers.stanford.edu

    Stanford is an equal opportunity employer and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other characteristic protected by law.




    jeid-0d18b10590249b4f9cfe842f5961a989