I barely turn the Pot and it reaches goes from 0 to 255 in no time, I mean barely, I tried all the values for the sale ranging from 0 to 255 passing through 127, it react the same way.
My left leg of the pot is on GRD the middle is on the pin, and right leg on the Vcc. with 0.1uF cap gnd to pin.
is that it ?

i kept is very simple:

INCLUDE "modedefs.bas"
DEFINE OSC 20 'use external 20mhz crystal
CMCON = 7 : ANSEL = 0 : ADCON1 = 7
DEFINE LCD_DREG PORTB ' Set LCD Data port
DEFINE LCD_DBIT 4 ' Set starting Data bit (0 or 4) if 4-bit bus
DEFINE LCD_RSREG PORTB ' Set LCD Register Select port
DEFINE LCD_RSBIT 1 ' Set LCD Register Select bit
DEFINE LCD_EREG PORTB ' Set LCD Enable port
DEFINE LCD_EBIT 0 ' Set LCD Enable bit
DEFINE LCD_BITS 4 ' Set LCD bus size (4 or 8 bits)
DEFINE LCD_LINES 2 ' Set number of lines on LCD
DEFINE LCD_COMMANDUS 2500
DEFINE LCD_DATAUS 250
DEFINE CHAR_PACING 2000


TRISB = 0
TRISA = 1
'27
temp var word : right var byte : left var Byte : oldright var byte : oldleft var byte

loop:


oldright = right 'Pot reading 1
oldleft = left 'Pot reading 2

Pot PORTA.0,127,right
Pot PORTA.1,127,left
right = (right +oldright)/2 'Reducing the fluctuating output by taking an average
left = (left +oldleft)/2

Lcdout $fe, 1 'Clear screen
Lcdout "Right: ", Dec right 'Display the decimal value
Lcdout $fe, $C0, "Left: ", DEC left 'Display the decimal value
pause 100

goto loop
end