Senior Big Data/Hadoop Architect (UCP 9)
Job Title: Senior Big Data/Hadoop Architect (UCP 9)
Job ID: 2018596
Location: Hartford Campus
The University of Connecticut (UConn), Analytics and Information Management Solutions (AIMS) group (http://aims.uconn.edu) is seeking to hire a Senior Big Data/Hadoop Architect (UCP 9) to lead the innovative design, development, and implementation (DDI) of a Big Data/Hadoop technical architecture supporting cross-functional, multi-platform applications for innovative analytics and information management solutions. This position will assist with the analysis of use cases' business/functional drivers and develop technical requirements and specifications to leverage next-generation technology to address complex, value-added real-world problems. This position will also support, assist, and advise leadership on the overall solution architectural design, research best-fit technologies, and identify potential technology considerations. This position is at the downtown Hartford campus.
UConn AIMS, working with the State of CT's Office of Health Strategy (OHS), is leading the design, development, and implementation of the Core Data Analytics Solution (CDAS), which will leverage leading-edge technologies to curate, process, and enhance large amounts of healthcare data to fuel the analytics to support state-wide healthcare initiatives.
DUTIES AND RESPONSIBILITIES
- Architect and lead the complete life cycle of a Big Data/Hadoop frameworks and architecture implementation.
- Provide integrated infrastructure-related technical expertise, from conceptualization and project planning to the post-implementation support level
- Design and develop big data concepts, Hadoop ecosystem components, and complimentary technologies such as HDFS, Hive, Spark, HBase, Oozie, and Kafka; as well as cloud technologies such as block storage, object storage, computational infrastructure services, and higher-level database services.
- Design and develop data flow and transformation processes pipelines for ingestion and analysis using modern toolsets such as Spark on Scala, Kafka, Flume, Sqoop, and others.
- Design data capture, security, processing, organizing, and provisioning structures to ingest various healthcare data sets to enable data enhancement, enrichment, and exploration/mining.
- Resolve complex systems integration issues including activities associated with various solution components and networking technology.
- Work with vendors' technical personnel in evaluating, planning for, and installing software products.
- Investigate performance issues and resolves program product level and/or control program level performance issues.
- Conduct research on emerging technologies, and recommend technologies that will increase operational efficiency, infrastructure flexibility and operational stability.
- Self-motivated/guided and able to work in a startup environment.
- Bachelor's degree (or equivalent) in Software Engineering, Computer Science, Information Systems, or a related Science, Technology, Engineering and Mathematics (STEM) discipline.
- Three to Five (3-5) years' experience in Structured, Semi-Structured and Un-structured data with progressive responsibilities in data architecture.
- Three to Five (3-5) years' experience architecting, designing, and developing Big Data frameworks and components, such as Hadoop, Spark, Storm, HBase, HDFS, NIFI, Pig, Hive, Scala, MapReduce, Yarn, Kafka, PyScripts, Unix Shell scripts, Hadoop streaming, Oozie, Sqoop, and/or Ranger.
- Experience with Hortonworks Big Data/Hadoop and Apache technologies for real-time and batch processing and the ability to do capacity planning.
- Experience with various forms of data design, such as OLTP, OLAP, ODS, X Normal Form, and data stores (Star and Snow Flake schemas).
- Experience with Agile SDLC.
- Knowledge of Big Data security components, such as data encryption, masking, and data use entitlements.
- Strong verbal and written communications skills and ability to lead effectively across diverse teams, providing mentorship to team members.
- Experience with Azure IaaS, including readiness, provisioning, security, and governance.
- Experience with Informatica Big Data Management (BDM) tools
- Exposure to microservices/blockchain based solutions.
- Experience with Big Data security components, such as data encryption, masking, and data use entitlements.
- Experience in any of the following programming language Scala, Python, or R and advanced knowledge in Scala/Python frameworks.
- Experience configuring visualization tools, such as Tableau, with Big Data/Hadoop cloud environment.
- Experience implementing security components, such as data encryption, masking, and data use entitlements.
- Experience in Metadata management, data lineage, data governance, especially as related to Big Data.
- Experience with various healthcare formats and reference data sets, such as, HL7, claims, eCQMs, drug/pharmacy, clinical notes, lab results.
- Experience implementing Big Data/Hadoop in a cloud-based infrastructure as a service (IaaS).
This is a full-time, grant-funded position that is subject to annual renewal depending on available funding and job performance. The standard work schedule is Monday – Friday, 8:30 am – 4:30 pm. Salary will be commensurate on the successful candidate's background and experience. Work location is at the Hartford campus.
To apply, please submit an online application that includes a cover letter, a resume and contact information for three (3) professional references, online via UConn Jobs, Staff Positions (www.jobs.uconn.edu). Evaluation of applications will begin immediately. Employment of the successful candidate is contingent upon the successful completion of a pre-employment criminal background check. (Search # 2018596)
This job posting is scheduled to be removed at 11:59 p.m. Eastern time on June 6, 2018.
All employees are subject to adherence to the State Code of Ethics which may be found at http://www.ct.gov/ethics/site/default.asp.
The University of Connecticut is committed to building and supporting a multicultural and diverse community of students, faculty and staff. The diversity of students, faculty and staff continues to increase, as does the number of honors students, valedictorians and salutatorians who consistently make UConn their top choice. More than 100 research centers and institutes serve the University's teaching, research, diversity, and outreach missions, leading to UConn's ranking as one of the nation's top research universities. UConn's faculty and staff are the critical link to fostering and expanding our vibrant, multicultural and diverse University community. As an Affirmative Action/Equal Employment Opportunity employer, UConn encourages applications from women, veterans, people with disabilities and members of traditionally underrepresented populations.