Improve character index of token tracing information for better visualization of Java matches

[tsaglam]

Fixes the tracing information for ASSIGN, VARDEF, NEWCLASS, and APPLY tokens in the Java language module.

Old:

31              int myVariable = 77777777;
                |VARDEF                 |

32              myVariable--;
                |assign

33              myVariable = myVariable - 1;
                |assign

34              int[] myArray = new int[7000];
                |VARDEF                     |
                                |NEWARRAY

35              System.out.print(myVariable + 200);
                |apply

(variable definition includes initialization, assignment has length 1, new array or class has length 1, apply not correct)

New:

31              int myVariable = 77777777;
                |VARDEF         |

32              myVariable--;
                |ASSIGN    |

33              myVariable = myVariable - 1;
                |ASSIGN    |

34              int[] myArray = new int[7000];
                |VARDEF        ||NEWARRAY   |

35              System.out.print(myVariable + 200);
                |APPLY         |

(context includes only what is necessary, no length 1 tokens)

Diff:

31              int myVariable = 77777777;
-                |VARDEF                 |
+                |VARDEF         |

32              myVariable--;
-               |assign
+               |ASSIGN    |

33              myVariable = myVariable - 1;
-               |assign
+               |ASSIGN    |

34              int[] myArray = new int[7000];
-               |VARDEF                     |
-                               |NEWARRAY
+               |VARDEF        ||NEWARRAY   |

35              System.out.print(myVariable + 200);
-               |apply
+               |APPLY         |

[TwoOfTwelve]

The changes look good.
I have tried the printer with an array with initializer and the tokens are generates as follows:

2           public int[] x = new int[]{Math.random(), Math.random(), Math.random()};
            |VARDEF         ||NEWARRAY                                            |
                                       |arrinit{
                                       |APPLY    |    |APPLY    |    |APPLY    |  |}arrinit

Maybe it would be better if NEWARRAY would close after [] instead of at the end of the statement. The visualization might be better if tokens don't overlap as much.

[tsaglam]

Yes, that would be better. I will fix it!

EDIT: THis is how is looks now...

54              int[] x = new Integer[] {Math.random(), Math.random(), Math.random()};
                |VARDEF  ||NEWARRAY |    |arrinit{
                                         |APPLY    |    |APPLY    |    |APPLY    | |}arrinit

55              int[] y = {Math.random(), Math.random(), Math.random()};
                |VARDEF  ||newarray
                           |arrinit{
                           |APPLY    |    |APPLY    |    |APPLY    | |}arrinit

56              int[] z = new Integer[3];
                |VARDEF  ||NEWARRAY |

57      
58              String text = new String("Hello, world!".getBytes("UTF-8"), 7, 5, "UTF-8");
                |VARDEF      ||NEWCLASS| |APPLY                 |

59              Boolean bool = new Boolean(false);
                |VARDEF       ||NEWCLASS |

[sonarcloud]

Quality Gate passed for 'JPlag Plagiarism Detector'

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud