Applied Data & Governance at a Research-Practice Partnership

Applied Data & Governance at a Research-Practice Partnership

by Nick Tallant

I have spent the last six months at the Consortium on School Research as an inaugural Applied Data Fellow for the International Innovation Corps, a program at the University of Chicago’s Harris School of Public Policy. A unit of the Urban Education Institute, the Consortium is a well established research-practice partnership with the Chicago Public Schools located right next door to the Harris School, where I am a graduate candidate.

Finding my fellowship placement in research - let alone next door to the studies I was leaving for a year - initially left me apprehensive. The IIC had promised an opportunity to “translate data-driven insights into actionable policy recommendations, new programs, and operational changes” - could this be done by writing papers? Was a year of research going to exercise my skills developed in my professional schooling? Fortunately, I am happy to report that the IIC was able to fully deliver on its promise.  I am confident my work will not only further my career goals of policy action and practice, but will also impact the well-being of students in the Chicago Public Schools and other large urban school districts for many years to come.

The Consortium is an interesting cog in the machine of education and education policy within Chicago, and has become my ideal example of a research-practice partnership. Coburn, Penuel, and Geil at the William T. Grant Foundation, provide the best high level description of such a relationship that I have seen:

“[Research-practice partnerships] foster reciprocal interaction in which practice informs research and vice versa. At their best, these partnerships facilitate the development of more relevant, actionable research and its use within the practice community.“

The key driver of impact is the bidirectional flow of ideas between researchers and practitioners. In my time at the Consortium, we have continually discussed our research with the Chicago Public Schools and other stakeholders such as the Illinois State Board of Education and Chicago Teachers Union to share and to listen. I am able to inform my research with the context and on-the-ground knowledge of practitioners and they are able to empower their practice with my research.

While we strive to communicate our work, the Consortium pursues its mission of building capacity for school reform through research, not policy recommendations or actions. My opportunity for data-driven insights on policy-action as a fellow therefore requires my research be so accessible and plainly communicated that the range of optimal policy actions seem apparent. The sophistication and depth of our analysis makes this task an incredible challenge. Confidence needs to be inspired in the methodology without becoming too technical, objectivity needs to be present while equity needs to be prioritized, and general conclusions need to be communicated without generalizing too broadly. A delicate balance needs to be taken as a technician and a communicator - exactly the role ascribed to an Applied Data and Governance Fellow. I believe the need for this type of role will grow alongside the presence of data in our social life and social systems, and am thankful to the IIC and the Consortium for providing an opportunity to grow along with it.

Harmonizing Investments with Impact: Cook County's Justice Advisory Council

Harmonizing Investments with Impact: Cook County's Justice Advisory Council

By Evelyn Sanchez Hernandez

The media portrait of Chicago as a dangerous place is sadly accurate for the South and West areas of the city. [1] These areas report the highest concentration of gang violence and criminal activities. Residents in these areas are thus more susceptible to falling prey to this vicious cycle of violence as victims or perpetrators. The life path of these individuals is further impacted once they become part of the criminal justice system. Incarceration decreases productivity, limits employment opportunities, and in many cases, produces trauma. [2]

Due to these harmful results, Cook County, where Chicago is located, has diversified actions to reduce the number of people behind bars in recent years. The strategies used to reach this goal have included setting affordable bail amounts for nonviolent felonies, reducing mandatory probation periods, helping people attend court appointments, and promoting alternatives to arrests for residents facing a mental health crisis. These strategies have proven to be successful: the number of inmates in Cook County jail has dropped to around 6,000 in 2018 from a high of 10,000 inmates in 2007. [3]

The Justice Advisory Council (JAC), under the Office of the President of Cook County, manages a traditional grant program that has invested more than 14 million dollars from 2013 to 2018 to complement the county’s goal to reduce the population behind bars. These grants allocate resources to organizations in the county that offer services to “at risk” populations, in order to prevent violence, reduce recidivism, and conduct activities of restorative justice such as peace circles and mediation services.

As a fellow assigned to JAC under the University of Chicago Harris School of Public Policy’s Applied Data and Governance Program, one of my first tasks was to help JAC refine the definition of “at-risk”. One of the requirements to access JAC grants is that services should be directed towards “at-risk” populations. However, there was no clear standard to ensure grantees followed this directive. JAC was concerned that this definitional ambiguity had resulted in grants accruing to organizations focused on serving economically deprived populations without considering other pertinent risk factors, such as mental health or academic performance. Additionally, without a standard of risk, it was difficult to define which groups needed the most support and prioritize accordingly. For instance, one of the questions that came up in discussion was: were gang members more at-risk than students who have to walk every day into the gangs’ territories as part of their schedule?

To tackle this challenge, I followed two strategies. First, I conducted an exercise to understand the status quo in which I interviewed Cook County grantees to tease out their understanding of “at risk” populations. I interviewed 7 organizations that currently receive support from JAC. From this activity, I learnt that the perception of risk factors was similar among all groups, and almost all estimated that people in their programs were at high risk or very high risk. The service providers generally pointed to the same risk factors: previous criminal justice involvement, gang membership, and a violent community environment. While the organizations agreed on risk factors, they differed in how they interact with the populations at-risk, as well as their recruitment strategies and methods of risk assessment.

Recruitment strategies were diverse. Some organizations have agreements with the Probation Department to enroll individuals already identified as “high-risk”, while others maintained school networks that refer students under adverse situations. In addition, some have an open strategy that allows participants to voluntarily register their programs or participate based on their own needs and interests.

Looking at the different types of recruitment strategies was useful to understand the population profile engaged by the organizations. Open registration could create “self-selection” of low-risk participants, since individuals that most need intervention may be less likely to enroll voluntarily. Additionally, referral networks are helpful to target participants “at-risk”, especially when the organization has limited capacity to identify risk factors among their potential participants.

Risk assessment protocols differed as well, impacted most significantly by the scale of the organization. Larger and more experienced organizations use certified assessment and screening instruments to detect risk factors, mental health and substance abuse for their participants. Smaller organizations rely on self-report data or intake questionnaires to detect risk factors.

This difference was relevant because certified risk assessments instruments are more effective to identify special needs and degree of risk (low-high), in order to provide specific services to the participants. Intakes questionnaires and self-reported data can provide useful information too, but they are not entirely reliable since the participants can omit information necessary to identify risk. Additionally, some risk factors, as mental health problems, are not often easy to detect through general questionnaires. [4]

My second strategy was to look towards research and academia to set a baseline definition. One remarkable study conducted by Chapin Hall in collaboration with the Cook County Probation Department and Get In Chicago, a nonprofit focused on youth violence prevention, captured my attention. The study created a predictive profile of youth between 18 to 30 years old, in certain areas of Chicago, that are most likely to be involved in criminal activities in a one-year period. To create this profile, the study analyzed the criminal backgrounds of youth in probation and their families, and examined their school and social service records. [5] According to the results, the main predictive factors of recidivism for this population were repeated arrest records (more than 4 arrests), gang involvement, chronic school absenteeism and a history of mental health illnesses. [6]

 Through interviews with Nick Mader, a researcher from Chapin Hall, and former and current staff member of Get In Chicago, I learned that regardless of the wonderful insights this study offered, it was not a definitive step to understanding the type of population that needs to be prioritized under JAC grants. I was also warned that due to the specificity of the study, this risk profile might differ for a different population even in other neighborhoods of Cook County.

Another main insight from the interviews with the researchers is that even if we could identify the "perfect" profile of high at-risk population, this wouldn't be helpful if the service providers do not have the capacities to attract this population, or cannot detect risk factors among their potential participants. For this reason, I determined that the main challenge was to establish grant funding conditions that attracted organizations effectively targeting correct “at-risk” populations, without excluding organizations that do not have a sophisticated enrollment or assessment process as of today, in the hope that funding would enable them to develop these capacities.

I recently presented the results from my research and interviews and recommended adding sections to the grant’s Request for Proposals to require organizations to describe in detail their target population, risk factors of the target population, recruitment strategies, and assessment risk capacities. I believe that these modifications will help JAC to not only to have better criteria for selecting the most effective programs, but will also be useful to pinpoint areas where service providers need more support to reach their objective of helping the Cook County’s vulnerable populations break out from generational cycles of violence


[1]  In 2016, 50 percent of the shootings reported to the Chicago Police Department concentrated in neighborhoods in the South and West areas of Chicago. https://www.ipr.northwestern.edu/about/news/2018/crime-in-chicago-research.html

[2] According to the Pew Charitable Trust, in U.S. “serving time reduces hourly wages for men by approximately 11 percent, annual employment by 9 weeks and annual earnings by 40 percent”. The Pew Charitable Trusts, 2010. Collateral Costs: Incarceration’s Effect on Economic Mobility. Washington, DC: The Pew Charitable Trusts. For the electronic version, click here

[3] For information on the jail population in 2010, please check Olson, D.E., Tahier, S. (2012). Population Dynamics and the Characteristics of Inmates in Cook County. Chicago, Illinois, Cook County Sheriff's Reentry Council. For jail population from 2017 to present check Sheriff’s Office website, www.cookcountysheriff.org.

[4] There is a wide diversity of risk assessment tools. For instance, by 2014 more than 20 were used in the Juvenile System across the U.S., according to the Office of Juvenile Justice and Delinquency Prevention. Some examples of risk/needs are:  1) Youth Assessment and Screening Instruments (YASI): measures an individual youth’s level of risk for delinquent conduct, key areas of programming or service need and protective factors which can be fostered to produce positive outcomes for the youth and family. 2) Structure Assessment of Violence Risk of Youth: assessment designed to estimate the risk of youth committing a specific offending behavior (like violent crime).

[5] For more information, visit https://getinchicago.org/understanding-youth-risk-level/. For a similar study on gun violence and recidivism please review  https://getinchicago.org/wp-content/uploads/2018/07/Juvenile-Probation-Report-Chapin-Hall-GIC.pdf

[6]  Remarkably, this study that used data matching through machine learning, omitted factors, such as postal code, school district, etc., that could be associated with race, in order to avoid interpreting race as a risk factor. Including race as a factor could bias the results since it might reflect possible justice system’s unequal responses to the offending behavior of different racial groups.

Accelerating Women's Economic Empowerment in India

Accelerating Women's Economic Empowerment in India

Earlier this month, the IIC and SEWA hosted a roundtable discussion to discuss critical challenges and opportunities faced in empowering the economic situations of women in India. A video summary of the roundtable, as well as a PDF of the executive summary of the joint report, is available below.

The Quest for Universal Quality: Financing Healthcare in India

The Quest for Universal Quality: Financing Healthcare in India

At just 1.2% of the GDP, India’s public health spending continues to be among the lowest in the world, while public health infrastructure in the country faces significant gaps. The National Health Policy 2017 expresses the intent to universalize health care and provide quality care at affordable rates.  But several challenges and uncertainties remain for India to realize this goal. There is a pressing need for innovative models of financing healthcare and ensuring quality health service to all citizens across the country.

To shed light on these issues and address the most pertinent issues regarding the demand and supply of quality healthcare, the International Innovation Corps (IIC) organized a panel discussion titled “The Quest for Universal Quality: Financing Healthcare in India” on January 30, 2018.  The panel featured Dr. William Haseltine (Chairman and President, ACCESS Health International), Dr. Shamika Ravi (Director of Research, Brookings India and Member, Economic Advisory Council to the Prime Minister of India), and Dr. Dinesh Arora (Director, Health, NITI Aayog).  The panel was moderated by Dr. Anup Malani (Faculty Director of the IIC, and a professor at the University of Chicago Law School, and the Pritzker School of Medicine).

Dr. Dinesh Arora, Dr. Shamika Ravi, Dr. William Haseltine and Dr. Anup Malani address the most pertinent issues regarding the demand and supply of quality healthcare in India. 

Dr. Dinesh Arora, Dr. Shamika Ravi, Dr. William Haseltine and Dr. Anup Malani address the most pertinent issues regarding the demand and supply of quality healthcare in India. 

The panel discussed a range of issues about the health sector in India – from the need to develop a process for electronic health records to mapping the exact health demand across the country. Some key themes emerged from the conversation:

‘Quality of Care’ needs to be defined and prioritized

Currently, there is a much greater focus on providing access to healthcare than on ensuring quality of care. Quality of care, while a nuanced concept, is critical to ensuring a comprehensive realization of universal healthcare. Quality needs to be defined through the development of robust metrics through which health outcomes can be assessed.

A shift is required in government spending, with an increased focus on increasing awareness and demand

Until now, the government’s primary focus has been on building medical infrastructure and manpower. There has been little focus on the demand side – with limited efforts to increase the public demand of healthcare in order to strengthen the public medical system. This is also evident in the excessively low utilization rates of Government Public Health care schemes, such as the Rashtriya Swasthya Bima Yojana (RSBY). Thus, a systematic approach to awareness building needs to be adopted to ensure that citizens access the healthcare avenues and schemes provided by the government. Concurrently, with these demand-side gaps in mind, policies with simpler instructions and more streamlined operations need to be designed so that they may be easily accessed.

A strong accountability and performance incentive structure is required to improve service delivery

Comprehensive access to equitable quality care is only possible when there is strong accountability in service delivery. Electronic health records and digitized intermediary processes (such as HMIS) that facilitate studies of patient flow and the management of medical facilities are a step in this direction. At the administrative level, the ranking of states based on their performance on health indicators would likely incentivizes states to invest a greater effort.

Robust medical data infrastructure is critical to enhancing the efficiency of healthcare processes

India’s healthcare system collects an enormous amount and wide variety of medical data. Despite this, there are serious issues across the data management cycle, which greatly reduce the data’s usability and amplify the data gaps. From non-standardized practices in data collection and compilation to inefficient analysis, a range of challenges make the data collected unhelpful and ineffective in decision making. In light of this, it is crucial to develop robust infrastructure, while redesigning existing data management processes.

Varun Jhaveri discusses the pressing need for innovative models of financing healthcare and ensuring quality health service in India. 

Varun Jhaveri discusses the pressing need for innovative models of financing healthcare and ensuring quality health service in India. 

Ultimately, the real challenge for realizing Universal Health Coverage lies in the implementation of processes. This will require a balanced approach to the demand and supply of healthcare, but a central focus on quality will be critical to this effort. The successful implementation of Universal Health Coverage will also need proven processes and methods to increase accountability, as well as a channel of systematic financing, to ensure that decision making is driven by data and evidence.

The Challenge of Scoping

The Challenge of Scoping

by Nitya Nangalia, Team SEWA

Choosing projects in decentralized organizations

Every IIC team starts the year by stepping in the shoes of a project designer.  Being consultants we come with little context of the organization, have very tight timelines and are tied to massive expectations. The experience of every team differs based on their client. For our four-member team working with the non-profit SEWA Bharat the challenge increased manifold - how do you identify and define your project for the year in a geographically spread, resource-constrained, decentralized organization working on multiple programs at the same time. Based on our 6-week stint of scoping, we reviewed what worked and what would have helped us better in the scoping process and have five major insights - 

#1 Spend time understanding the organization

In the beginning of a consulting project, either the client or consulting team themselves may be eager to produce output from Week I. However, for any incoming team it is important to get enough time to understand the organization and ensuring the client gives you space to do it. If not given time, daily tasks can soon turn you into extended arms of existing work in organization, leaving no way to assess what could have the best fit project for the year based on client needs and the team capacity. We recommend requesting the client some time for a detailed scoping exercise, with an expectation of no deliverables in the meantime. When asked, they do listen - as we happily learnt from our experience.

#2 Prioritise building processes and tools

Once we started work, it was easy to get lost in multiple projects and states. To illustrate, SEWA in one district of Bihar hosts 8 different projects - Advocacy, Social Security, Waste Management, Goat-Nursing, Skill Development, Microfinance, Renewable Energy and Sustainable Agriculture - each working on slightly different models than their sister districts and staffed by people taking on multiple roles. Fortunately, our team spent time building processes which not only saved us from getting lost, but also made it simpler to gather insights by looking at the output.. We recommend the following tools when scoping - 

  • Define roles for all meetings - meeting leads, scribes, translators 
  • Build questionnaires for interviews
  • Use process maps to get a baseline
  • Hypothesize deliverables and estimate effort required for chosen work streams
  • Use a consideration matrix to evaluate the feasibility, sustainability, need and interest of proposed projects
Screen Shot 2017-12-14 at 9.51.22 AM.png

In a design thinking approach of convergence and divergence in projects, these tools acted as a very useful way to help us converge on similar parameters across different work streams. 

#3 Most people answer the Why - Also address the How

One great learning from our scoping experience is that most of our time was spent in determining what was happening and answering why are we choosing certain projects over others. While we spent time pondering over the feasibility of the project, we did not spend enough time thinking over HOW to make the project possible. One solution our team considers in retrospect is devoting one week of the team’s time in actually working on some tiny area of the project to open up the pandora box of operational challenges yet unforeseen.

#4 Know when to stop. 

There is no end to knowledge gain, but the value added from this exercise can soon diminish given time constraints. For us, scoping soon became a research project rather than giving us more actionable insights, also because we were more document biased than relying on personnel interviews. Given the large scope of work we were taking on for the year and the implementation heavy side of the project, scoping was essential but devoting too much time to it would have reduced time for implementation. Every extra minute given to scoping reduces time for actual implementation.

Screen Shot 2017-12-14 at 9.49.40 AM.png

#5 Don’t hesitate to change course, even afters scoping

Even though scoping is important, but we recognize that once a team gets started, the nature of problems change very quickly.  We started with six interest areas but the same challenges surfaced in every work stream and diverted our energies on different issues entirely. Our projects transformed within a month of scoping - 

Screen Shot 2017-12-14 at 9.50.49 AM.png

Remember, scoping is just the first hunch on what you think you will be working on for rest of the year. 


SEWA is a movement for empowerment of women in working in the informal sector. Started in 1972 by Ela Bhatt in Gujarat, the movement has now spread to 14 states across India with almost 2 million women members. The only women’s trade union in India, SEWA believes change comes from the grassroots and is inspired by its members’ belief - ‘We are poor, but so many’.

 

Incubating Impact: Supporting start-ups that matter

Incubating Impact: Supporting start-ups that matter

By Nayantara Nath, IIC- Social Alpha Team

With the world’s highest number of registered non-profit organizations—3.1 million[1]—and burgeoning amount of for-profit social enterprises—2 million[2]—the philanthropy sector in India has been on the upswing for the past 5 years[3]. Yet, the UN Human Development Index (HDI) Report 2016 ranked India as 131 out of 188, with the HDI falling by 27% due to rising regional disparities in education, health parameters and living standards across the country. Experts agree there is a greater need for philanthropic funding and resources directed towards both non-profit & for-profit organizations to address India’s immense development challenges.

Traditional grant-centric funding models are slowly giving way to atypical investment approaches; the philanthropic ecosystem is evolving significantly, owing to the combined efforts of the public and private sector to promote social entrepreneurship, start-ups, and innovation-based interventions. Increasing government impetus and political will, coupled with the rise of incubation centers, accelerators, and impact investors have contributed to the rapid evolution of the sector.

Enter Social Alpha

Social Alpha, a joint initiative of the Tata Trusts and the Department of Science & Technology, is a three-tier ecosystem architecture designed to nurture non-profits and for-profit social enterprises throughout their journey from lab-to-market. These tiers comprise innovation support, incubation of enterprises, and investment in enterprises looking to scale. This architecture is designed to address the gaps left by the state and private sector in terms of provision of strategic guidance, seed capital and execution to social entrepreneurs and innovators.

With a deep focus on impact, Social Alpha has identified that science and technology innovations have the potential to bring about non-linear leapfrogging change in the life of the bottom-of-the-pyramid, by creating high quality yet affordable solutions.  However, currently in India, it is difficult for such enterprises to find resources due to high early-stage risk, complex product-development journey, long gestation period, and low returns. Further, it has been documented that tech-entrepreneurs themselves may require capacity building, handholding, and guidance from mentors to take their products to market, and build scalable and sustainable enterprises.

With a lean team dedicated to addressing these needs and a portfolio of 20+ high-risk high-impact enterprises, Social Alpha has entered its second year of operation, and is looking to scale rapidly. 

Incubating the Incubator

The IIC-Social Alpha team is working with Social Alpha, across functions and tiers, to develop and strengthen the identification, selection, incubation, and monitoring and evaluation of ‘incubatee’ organizations. Instituting processes that are adaptable at scale is the key implementation challenge that the team has taken into consideration. Adopting a research-based approach, the team has conducted over 60 in-depth exploratory interviews with incubators, accelerators, social entrepreneurs, impact investors, academic experts, mentors and social enterprise consultants, as well as team members of Social Alpha to understand the points of distinction between the functioning of these organizations. Post conclusion of this phase, the team has matched the findings from the external discussions to the key priority areas identified from the internal conversations.

It has emerged from our research the key challenges that most social incubation, acceleration and impact investment programs in India face include: effective scouting of high-impact enterprises, systematically assessing their needs, providing of capacity building, knowledge services & handholding support to advance them on their journey, and evaluating their performance (both in terms of impact and returns) in a timely manner.

Building on insights from external interviews and secondary research, our team has now formulated preliminary recommendations that seek to set a new industry standard in social incubation for efficiency at scale.

Looking ahead

The social entrepreneurship and innovation sector in India is still at a nascent stage, with many new entrants in the market testing out experimental structures. In this dynamic environment, there is ample opportunity to pilot new processes and strategies. Our team is looking to design and implement inventive grand challenges and fellowships for scouting of social entrepreneurs, and sector-focused mentorship and capacity building programs in the upcoming months. The team is also looking to adopt an end-to-end digital tool for managing the functions of the incubator, and to formalize the partnerships and associations between organizations in the sector.

The need of the hour is to promote a culture of collaboration in both the social entrepreneurship and philanthropic sector due to a large number of organizations working on overlapping fields. To ensure that expertise, resources, and skill percolate to those who require it, it is necessary that there is increased coordination and knowledge-sharing efforts between players. There is also potential for awareness building to inform and educate the next generation of innovators regarding social entrepreneurship as a viable career option. Levying equal focus on empathy and efficiency at every step in the process, will lead to the creation of a new cadre of problem-solvers who can confidently undertake the mammoth task of countering India’s social challenges.

 

 

[1] ‘India has 31 lakh NGOs more than double the number of schools’, The Indian Express: http://indianexpress.com/article/india/india-others/india-has-31-lakh-ngos-twice-the-number-of-schools-almost-twice-number-of-policemen/

[2] The State of Social Enterprise in Bangladesh, Ghana, India & Pakistan, British Council: https://www.britishcouncil.org/sites/default/files/bc-report-ch4-india-digital_0.pdf

[3] India Philanthropy Report 2017, Bain & Company: http://www.bain.com/publications/articles/india-philanthropy-report-2017.aspx

Varun Jhaveri, IIC Project Lead, selected to meet President Obama in New Delhi

Varun Jhaveri, IIC Project Lead, selected to meet President Obama in New Delhi

Varun Jhaveri, IIC’s SAST Team Project Lead, has been selected as one of the Young Leaders from India to meet and interact with President Obama in the Townhall organized by the Obama Foundation on December 1, at New Delhi. The platform will assemble similar young leaders working on wide array of developmental issues in the country. The Town Hall will expand the conversation about what it means to be an active citizen and make an impact — and how the Obama Foundation can support emerging leaders in this effort.