You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Regex rule fails with an NPE if a row contains an empty field and the field must be checked.
18/04/11 17:57:52 WARN scheduler.TaskSetManager: Lost task 1.0 in stage 1.0 (TID 3, ****.****.**, executor 4): java.lang.NullPointerException
at java.util.regex.Matcher.getTextLength(Matcher.java:1283)
at java.util.regex.Matcher.reset(Matcher.java:309)
at java.util.regex.Matcher.<init>(Matcher.java:229)
at java.util.regex.Pattern.matcher(Pattern.java:1093)
at com.cloudera.labs.envelope.derive.dq.RegexRowRule.check(RegexRowRule.java:55)
The class com.cloudera.labs.envelope.derive.dq.RegexRowRule need a null check in the method check(Row row): boolean:
@Override
public boolean check(Row row) {
boolean check = true;
for (String field : fields) {
String value = row.getAs(field);
Matcher matcher = pattern.matcher(value);
check = check && matcher.matches();
if (!check) {
// No point continuing if failed
break;
}
}
return check;
}
The text was updated successfully, but these errors were encountered:
Regex rule fails with an NPE if a row contains an empty field and the field must be checked.
The class
com.cloudera.labs.envelope.derive.dq.RegexRowRule
need a null check in the methodcheck(Row row): boolean
:The text was updated successfully, but these errors were encountered: